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ABSTRACT:  Previous  presentations  have  outlined  the  overall  goals  and  approach  for  the  SISO  Intrinsic  Earth 
Surface  Material  Classifier  System  project  currently  underway  within  the  Office  of  Naval  Research/SBIR  Program. 
Recent  work  has  focussed  on  two  aspects  of  the  project:  1)  creating  the  Preliminary  Surface  Material  Standards  list  and 
2)  deriving  the  baseline  surface  rendering  equation  needed  to  translate  intrinsic  material  properties  to  measured 
observables.  This  paper  presents  a  review  of  the  surface  rendering  equations,  in  the  wavelength  range  from  the 
VIS/NIR  through  the  TIR  region,  used  by  computer  simulation  and  remote  sensing  communities.  We  then  examine  the 
advantages  and  shortcomings  of  each  candidate  equation  with  respect  to  the  following  question  -  Flow  does  the 
candidate  equation  allow  users  to  create  simulated  spectral  information  for  a  *natural*  surface  under  sensor  and 
environmental  conditions  typically  occurring  in  low  orbit  satellite,  aerial  survey,  remotely  piloted  vehicle,  and  ground 
based  data  sources?  Along  with  the  presentation  of  this  equation  are  the  definitions  of  the  intrinsic  material  properties 
that  act  as  input  to  the  formula  and  serve  as  candidate  intrinsic  parameters  for  a  standard  objective  earth  surface  model. 
Lastly  we  discuss  the  problem  of  mapping  the  equations  and  parameters  used  in  the  remote  sensing  community,  where 
earth  surface  measurements  take  place,  to  those  used  in  the  computer  simulation  community,  where  a  large  market  for 
realistic  reproductions  of  earth  surface  images  exists. 
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1,  Background 

The  computer  simulation  community  requires  the 
capability  to  quickly  and  easily  calculate  realistic  scenes 
that  accurately  represent  the  real  world.  In  order  to 
achieve  this  capability,  a  standard  database  of  surface 
materials  characterized  by  intrinsic  physical  properties  is 
required.  This  database  will  give  simulation  developers 
the  ability  to  create  realistic  surfaces;  complete  with 
expected  spectral  responses  at  any  wavelengths, 
observation  geometries,  and  environmental  conditions. 
The  goal  of  our  effort  is  to  build  the  infrastructure  for  the 
construction  of  such  an  earth  surface  material  database  at 
1  meter  resolution. 

Current  databases  are  woefully  inadequate  to  address  the 
needs  of  metrically  accurate  simulation  [1].  Vast  amounts 
of  source  material  are  available  in  locally  calibrated, 
project-specific  databases  and  more  data  are  being 
collected  as  additional  multispectral  and  hyperspectral 
systems  become  operational.  But  this  material  exists  in 
myriad  formats,  degree  of  completeness,  and  levels  of 
data  quality  and,  as  a  result,  almost  none  of  these  data  are 
directly  usable  for  enhancing  physical  realism  in 
computer  simulation  applications. 

Tools  for  extracting  intrinsic  properties  of  material  from 
remotely  acquired  data  are  basically  nonexistent  and  the 
suites  of  surface  rendering  tools  currently  available  are 
limited  in  scope;  in  other  words,  they  cover  an 


abbreviated  wavelength  range  or  include  only  a  limited 
set  of  material  types. 

The  SISO  Intrinsic  Earth  Surface  Material  Classifier 
System  project  [2]  will  develop  the  definition  of  a 
Standard  Surface  Material  Code  (SSMC)  which  will  be 
used  to  map  the  world.  To  a  modeling  and  simulation 
program,  such  a  code  acts  like  a  pointer  to  a  list  of 
intrinsic  earth  surface  material  parameter  values  that 
define  the  physical  and  radiometric  properties  of  the 
surface  over  a  broad  wavelength  range.  This  information 
will  reside  in  a  surface  materials  standard  list  - 
RESOLVE  (Radiometric  Earth  Surface  Observables  for 
Land  Visualization  Events),  which  includes  materials 
based  on  the  global  abundance  of  naturally-occurring  and 
man-mad  materials,  their  significance  (e.g.  importance)  to 
a  user  community,  and  availability  of  spectral  data 
sources  to  support  extraction  of  intrinsic  surface 
properties.  To  support  additional  modeling  and  testing 
goals,  we  will  include  "non-realistic"  materials  that  are 
characterized  by  specific  physical  or  spectral  properties 
generally  outside  of  nature. 

2,  Objective  of  this  Paper 

In  order  to  optimize  a  standard  set  of  material 
classifications  as  well  as  to  actually  map  the  world  from 
remote  sensing  data,  the  full  radiometric  sensing  problem, 
graphically  depicted  in  Figure  1,  must  be  solved. 


Figure  1:  Components  of  the  Radiometric  Sensing  Problem. 


This  problem  decomposes  down  into  five  distinct 
components,  listed  below: 

>  Illumination  Model 

>  Atmospheric  Propagation  Model 

^  Surface  Rendering  Model 

>  Thermal  Load  Model 

>  Sensor  Model 

In  this  paper,  we  address  the  properties  by  which  surfaces 
can  be  classified  and  therefore  concentrate  on  the  surface 
rendering  model.  Such  a  model  consists  of  a  set  of 
intrinsic  physical  surface  parameters,  a  definition  of  input 
energy  at  the  surface,  and  a  set  of  relationships  that  are 
used  to  calculate  the  energy  emitted  from  the  surface.  The 
basic  relationships  used  to  calculate  the  emitted  energy 
from  a  surface  will  be  called  the  “forward”  surface 
rendering  model. 

The  “inverse”  rendering  model  will  also  be  required.  In 
the  reverse  model,  the  emitted  energy  and  the  input 
energies  are  known  while  the  intrinsic  surface  parameters 
are  calculated.  The  inverse  form  of  the  surface  rendering 
model  will  allow  us  to  process  remote  sensing  data  into 
the  intrinsic  physical  surface  parameters  used  to  classify  1 
meter  surface  patches.  Including  the  inverse  rendering 
equation  as  part  of  the  information  list  pointed  to  by  the 
SSMC  code  fixes  the  mechanism  by  which  the  code  was 
assigned.  In  turn,  including  the  forward  model  allows  the 
consistent  calculation  of  emitted  energy  surface  energies 
from  each  1  meter  patch  under  multiple  viewing 
conditions  and  sensor  configurations. 

It  is  our  intent  in  this  paper  to  review  the  currently 
available  rendering  models  in  the  remote  sensing  and 
computer  simulation  communities  and  address  the 
question  of  how  the  earth  measurement  results  of  one 


community  can  be  transferred  and  utilized  by  the  other.  If 
we  can  successfully  answer  this  question  we  expect  to 
present  a  standard  SISO  rendering  equation  in  the  future. 

3,  Review  of  Candidate  Surface  Rendering 
Equations 

3.1  Equations  used  in  remote  sensing  -  The  Hapke- 
Shepard  Model 

The  surface  rendering  model  generally  used  by  the  remote 
sensing  community  is  that  derived  from  the  Hapke  [3] 
radiative  transfer  model  and  the  Shepard  [4]  specular 
reflectance  model;  for  our  purposes,  we  will  refer  to  this 
combined  model  as  the  Hapke-Shepard  model.  The 
equation(s)  derived  from  this  model  makes  several 
simplifying  assumptions,  which  we  have  also  adopted. 
These  assumptions  are: 

>  The  surface  is  relatively  smooth  with  respect  to 
the  wavelength; 

^  The  surface  is  in  thermodynamic  equilibrium, 
and 

^  The  surface  is  emitting  at  a  uniform  temperature. 

The  Hapke-Shepard  model  was  originally  derived  for 
barren  (rocks  and  soils)  natural  surfaces.  At  the  meter 
scale,  the  assumptions  listed  above  are  valid  for  these 
surfaces.  Vegetation  poses  a  more  complex  problem,  and 
will  be  not  be  addressed  specifically  in  this  paper, 
however,  we  are  actively  exploring  BRDF-based  kemal 
techniques  for  modeling  vegetated  surfaces. 

3.1.1  Geometric  and  Radiometric  Nomenclature 

We  begin  by  describing  the  geometric  and  radiometric 
nomenclature  that  will  be  used  throughout  this  paper. 


Where: 

i  =  incidence  angle 
e  =  emission  angle 

\|/  =  azimuthal  angle  between  the  planes  of 
incidence  and  emission 
g  =  phase  angle  (angle  between  incidence  and 
emission  angles) 

|i  =  cos  e 
Po  =  cos  i 

K)  =  single  scattering  albedo 
J  =  irradiance  at  the  upper  surface  of  the  medium; 
source  is  highly  collimated  radiation;  infinite 
distance  from  medium 
I  =  radiance  at  the  detector  =  l(i,e,g)x 


Collimated  light  (irradiance)  J  from  a  source  of  radiation 
is  incident  on  the  upper  surface  of  a  scattering  medium. 
The  normal  to  the  surface  is  parallel  to  the  z  axis,  and  the 
incident  light  makes  an  angle  i  with  the  surface  normal. 
The  light  interacts  with  the  medium,  and  some  of  the  rays 
emerge  from  an  element  of  AA  of  the  surface  traveling 
toward  the  detector  in  a  direction  that  makes  an  angle  e 
with  the  surface  normal.  The  plane  containing  the 
incident  ray  and  the  surface  normal  is  the  plane  of 
incidence,  and  that  containing  the  emitted  ray  and  the 
surface  normal  is  the  plane  of  emission.  The  azimuthal 
angle  between  the  planes  of  incidence  and  emission  is  y. 
The  angle  between  the  directions  to  the  source  and  the 
detector  as  seen  from  the  surface  is  the  phase  angle  g.  It 
is  defined  using  the  following  relationship: 

cos  g  =  cos  i  cos  e  +  sin  i  sin  e  cos  y  eq.  1 

The  plane  containing  the  incident  and  emitted  rays  is  the 
scattering  plane.  If  the  planes  of  emission  and  incidence 
coincide  (y  =  0  or  180°),  their  common  plane  is  called  the 
principal  plane.  Occasionally,  the  scattering  angle  0  (the 
complement  of  the  phase  angle)  may  be  used  instead  of  g. 


3.1.2  The  Hapke-Shepard  Equation 

Using  these  geometric  and  radiometric  descriptions,  the 
radiometric  equation  for  the  Hapke-Shepard  model(s)  is 
presented  in  Equation  2  below. 

Equation  2  describes  the  directional  radiance  emerging 
from  a  particulate  surface  that  has  been  illuminated  by  a 
collimated  light  source.  It  includes  also  the  effect  of 
thermal  emission  from  that  surface.  The  Ifi.e.gli  defined 
by  equation  2  is  the  radiance  (  power  per  area 
perpendicular  to  the  direction  of  travel  per  steradian  in  a 
wavelength  band)  that  would  be  measured  by  an  airborne 
or  spacebome  sensor  without  the  influence  of  atmospheric 
effects.  The  first  term  on  the  right  hand  side  of  equation  2 
describes  the  scattered  radiance  received  by  our 
hypothetical  sensor,  the  second  term  describes  the 
Shepard  specular  correction,  and  the  third  term  describes 
the  thermally  emitted  radiance. 
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where: 

is  the  ground  impinging  incident  solar  irradiance 
w  is  the  single  scattering  albedo  of  the  surface 
y  is  the  albedo  factor  equal  to  sqrt(l-  w) 
i  is  the  incidence  angle  po  is  cos  i 

e  is  the  exitance  angle  p  is  the  cos  e. 

bo  is  the  amplitude  of  the  opposition  effect 
approximately  equal  to  exp(-®/2) 
h  is  the  opposition  effect  width  parameter;  a 

compaction  parameter  (based  on  porosity  and 
particle  spacing) 
g  is  the  phase  angle 
p(g)  is  the  average  particle  angular  scattering 
function: 

p(g)  =  (l-^V((l+2^cos(g)  +  ^y^) 

^  is  the  cosine  asymmetry  factor, 

^  =  (cos0)=  -(cos  g) 

0  is  the  scattering  angle 


H(x)  described  multiple  scattering  and  is  approximated 
for  isotropic  surfaces  as: 

1-1-2  X 

\+2y>c 

R  is  the  Fresnel  power  reflection  coefficient 
R=(l/2)[sin2(j  -  P)  /  sin2(j-l-p)-l-  tan2(j-P)/tan2(j-l-p)] 

P  is  defined  by  sin-l(sin(j)/n) 

n  is  the  real  part  of  the  index  of  refraction 
j  is  equal  to  g/2 

P(0)  is  the  slope  probability  function;  it  describes  the 
probability  that  a  facet  will  be  oriented  such  that 
the  specular  reflection  from  this  facet  contributes 
to  the  overall  surface  specular  component 
P(0)  =  exp[s  tan(0)]  sr  ' 
s  is  a  smoothness  parameter 
U(>^,T)is  the  Planck  Function 

3.1.3  Intrinsic  Parameters  in  the  Hapke-Shepard 


Model 

In  order  to  calculate  the  radiance  using  this  theory  the 
following  "intrinsic"  parameters  describing  the  surface 
must  be  known. 

CO  is  the  single  scattering  albedo  of  the  surface;  this 
is  the  dominant  parameter 
h  is  the  opposition  effect  width  parameter  (a 
compaction  or  porosity  parameter) 

^  is  the  cosine  asymmetry  factor  (describes  the 
scattering  from  the  surface) 
n  is  the  real  part  of  the  index  of  refraction  of  the 
surface 

s  is  the  Shepard  smoothness  parameter 
n  is  the  surface  normal  vector 

This  list  of  five  parameters  and  one  vector  represents  the 
intrinsic  values  describing  the  surface  itself  The  other 
parameters  in  equation  2  are  either 

1)  derived  and  represented  as  functions 

2)  angles  representing  the  view  geometry  or 

3)  the  illumination  or  input  energy  load 

These  parameters  and  radiometric  equations  represent  the 
"best"  theory  from  the  remote  sensing  community  we 
have  been  able  to  identify.  If  the  Hapke-Shepard  model  is 
to  be  used  for  defining  the  earth  surface,  each  surface 
material  code  would  be  defined  by  explicit  values  given 
to  these  five  parameters.  By  knowing  the  code  assigned  to 
each  1  meter  ground  patch  and  equation  2  above  the 
radiant  power  from  the  patch  can  be  calculated  in  a 
computer  simulation. 

Unfortunately  these  equations  and  parameters  are  not 
used  by  the  computer  simulation  community  and  would 
not  match  existing  software  or  allow  easy  integration  with 
existing  modeling  databases.  It  therefore  does  not 
represent  an  optimized  set  of  parameters  for  intrinsic  earth 
surface  classification  useful  in  graphic  simulation. 
Finding  the  optimized  set  of  parameters  to  describe  a 
surface  patch  is  one  of  the  main  tasks  to  be  performed  in 
our  upcoming  study.  In  section  3.2  below  the  Equations 
used  in  graphic  simulation  will  be  presented  in  order  to 
define  the  intrinsic  parameters  suggested  by  this  very 
different  approach  to  surface  rendering 

3.2  Equations  used  in  Graphic  Simulation  -  The 
OpeuGL  Lighting  Model 

The  most  popular  real  time  rendering  equation  is  the 
OpenGL  [5]  and  the  similar  VRML  [6]  lighting  model. 
Many  computer  graphics  cards  have  accelerators 
specifically  designed  to  implement  this  equation.  It 
qualitatively  captures  all  the  major  contributions  to 
reflected  light;  emission,  ambient  illumination,  diffuse 
reflectivity,  and  specular  reflectivity.  In  color  systems  a 


triplet  of  parameters  are  needed  to  calculate  the  intensity 
(Ir,g,b)  with  which  each  of  the  RGB  monitor  guns  is  set. 
These  take  on  values  from  0  to  255  and  have  units  of 
color  per  pixel.  Each  RGB  component  is  calculated  using 
an  extension  of  the  Phong  lighting  model  [7]. 
Mathematically,  it  is  given  by  the  following  equation. 

^R,G,B  =  T{u,v)^ 

Eq.  3 

In  Eq.  3,  T(u,v)  is  the  texture  modulation  as  a  function  of 
the  texture  coordinates  u,v.  Ja,  h,  and  are  the 
normalized  ambient,  diffuse  and  specular  light  intensities 
respectively  with  values  between  0  and  1.  jUa,  //e,  //</,  and 
jUs  are,  respectively,  the  ambient,  emissive,  diffuse,  and 
specular  color  intensities  of  a  given  scene  object,  and  ^'is 
the  shininess.  The  vectors  /,  n,  and  s  are  as  defined  in 
Figure  4. 


Figure  4:  Geometric  definitions  associated  with  the 
OpenGL  lighting  model. 

Ignoring  the  texture  modulation  function,  it  can  be  seen 
that  Eq.  3  qualitatively  captures  the  geometric  behavior  of 
emission  and  reflection  from  a  surface.  Quantitatively,  it 
departs  from  physical  reality  in  several  ways.  These 
include: 

•  No  Opposition  or  self  shadow  effect 

•  Single  lobe  specular  reflections 

•  Non-linear  color  intensity  summation 

•  Non  Physical  zoom  intensities 

These  deficiencies  can  make  mapping  from  physically 
based  models  difficult  and  are  discussed  later  in  section  4. 


Despite  these  difficulties  the  OpenGL  equation  is  a  good 
first  order  approximation  to  surface  rendering  and  one 
might  take  the  approach  that  the  earth  surface  should  be 
mapped  in  terms  of  the  parameters  directly  usable  in  this 
equation. 

3.2.1  Intrinsic  Parameters  in  the  OpenGL  Lighting 
Model 

If  the  OpenGL  lighting  model  were  to  be  used  for  the 
definition  of  earth  surface  materials,  each  SSMC  code 
would  point  to  a  list  of  explicit  values  for  the  following 
properties: 

f^a  ambient  material  RGB  color 

fJe  He  emissive  material  RGB  color 

jUd,  diffuse  material  RGB  color 

jUs  specular  material  RGB  color 

g  shininess 

Note  that  we  have  divided  emissive  RGB  color  by  le  the 
emissive  (usually  thermal)  input  energy  intensity  since 
the  parameter  fie  is  simply  defined  as  the  emissive  color 
and  an  intrinsic  material  property  should  be  independent 
of  the  input.  As  in  the  Hapke-Shepard  model,  the  surface 
normal  must  be  estimated  and  recorded  in  the  1  meter 
earth  database  for  each  earth  surface  patch  but  is  not 
required  for  surface  classification.  The  ambient,  diffuse, 
and  specular  light  intensities  (la.  Id,  and  I*)  as  well  as  the 
thermal  input  and  the  illumination  and  view  vectors  are 
not  intrinsic  to  the  surface  itself  These  parameters  are 
supplied  by  one  of  the  other  models  listed  in  Section  3 
above  or  directly  by  simulation  software  at  run  time. 

The  color  components  could  be  used  as  a  means  of 
defining  the  surface  reflectivity.  It  requires  a  mapping 
from  the  perceptive  to  the  physical  scale  through  the 
definition  of  a  standard  observer  (e.g.  the  human  eye). 
Hence  the  use  of  apparent  color  to  define  intrinsic 
properties  is  possible.  The  advantage  of  using  OpenGL 
color  specification  to  define  natural  surfaces  for  a  1  meter 
earth  surface  model  is  that  once  such  a  map  has  been  built 
the  dominant  software  used  by  the  simulation  community 
could  simply  ingest  these  parameters  and  render  scenes 
without  modification.  The  disadvantage  is  that  the  remote 
sensing  community  does  not  measure  the  earth  surface  in 
perceptive  color  terms  but  rather  in  terms  of  physical 
parameters  presented  by  the  Hapke-Shepard  model. 
Consequently,  it  would  be  difficult  to  build  such  a  map 
from  available  measurements.  We  seek  to  bridge  this  gap 
in  the  following  section. 


Diffuse  reflection  direction  has  constant  amplitude  as  a 
function  of  the  cosine  of  the  incidence  angle  (the  pure 
Lambertian  surface).  Many  soils,  vegetation,  and  some 
paints  exhibit  the  opposition  or  enhanced  backscatter 
effect.  This  means  more  light  is  scattered  back  in  the 
direction  of  illumination  than  forward  in  the  direction  of 
the  specular  peak. 

The  major  cause  of  this  effect  is  the  self  shadowing  and 
obscuration  as  a  function  of  large  scale  roughness. 
OpenGL  can  partially  account  for  this  effect  by  using  a 
"texture"  parameter.  The  texture  simulates  shadowing 
from  a  rough  surface  by  introducing  dark  areas  where 
shadows  would  occur.  However  unlike  real  shadows, 
these  textures  do  not  change  when  the  view  angle  to  the 
surface  changes.  Hence  one  gets  a  cartoon  like  look 
similar  to  looking  at  a  painting  of  a  surface  from  the  side. 

To  quantify  the  importance  of  the  opposition  effect  we 
measured  the  reflected  light  intensity  from  eleven  natural 
surfaces  (Clean  Asphalt  Drive,  Twist  Texture  Rug, 
Rosemary  Bush  Top,  Garden  dirt.  Mica  flecked  flat  stone. 
Flat  Brown  Sand  stone.  Composite  Roof  Shingle,  Card 
board.  New  Cement  Roadway,  Worn  Asphalt  Road  with 
oil,  and  Cut  grass)  illuminated  by  the  sun  at  45°  elevation. 
Measurements  were  taken  in  the  specular  direction  and 
the  illumination  direction.  Only  the  cardboard  and  oily 
worn  roadway  showed  a  peak  in  the  specular  direction. 
The  bush,  grass  and  dirt  showed  a  peak  in  the  illumination 
direction  that  could  not  be  properly  rendered  with  the 
OpenGL  equation.  The  rest  showed  no  peak. 

The  OpenGL  lighting  model  is  a  good  approximation  for 
flat  manmade  single  facets  but  is  not  adequate  for  most 
natural  surfaces.  Such  surfaces  are  composed  of  many 
macroscopic  facets  and  cannot  be  broken  into  smaller 
pieces  during  the  remote  sensing  measurement  process. 
At  a  minimum,  additional  geometric  corrections  must  be 
added  to  accommodate  the  effects  of  macroscopic 
roughness. 

4.  Mapping  Physical  Model  Parameters  into 
OpenGL 

In  order  to  connect  remote  sensing  measurements  with 
computer  graphics  simulators,  OpenGL  subroutine 
parameters  must  be  mapped  to  radiometric  parameters 
derived  from  more  physically-based  models  of  scene 
illumination  and  viewing.  Similar  to  the  treatment  given 
by  Lorenzo  et  ah,  [8],  we  provide  below,  a  discussion  of 
the  physical  basis  of  the  OpenGL  equations  and  discuss 
the  problems  in  mapping  those  to  the  Hapke-Shepard 
theory  described  in  previous  sections. 


3.2.1  Self  Shadowing 


4.1  Radiance  to  Color  Intensity  Mapping 


A  fundamental  difference  between  the  OpenGL  and 
physically  based  modeling  is  that  OpenGL  uses  apparent 
color  intensity,  not  radiant  power.  OpenGL  equations 
calculate  the  color  intensity  (normalized  to  the  range  0  to 
255  by  a  gamma  correction-sensor  response,  not  Hapke’s 
gamma)  of  a  pixel  projecting  onto  a  surface.  In  physical 
modeling,  the  light  intensity  emanating  from  the  surface 
is  calculated  in  watts/cm^sr  *.  Figure  5  shows  the 
geometry  relating  the  two  approaches. 


The  pixel  intensity  Ip(e,i,g)},  (in  watts  per  pixel)  falling 
on  a  pixel  of  area  (Ap)  from  a  surface  area  (As)  is  related 
to  the  physical  radiance  I(e,i,g)x  , calculated  by  the  Hapke 
equation  2,  by  the  relationship: 


Ip,  =I(e,i,g) 

,•  As-  Srd-cos(e)  =  I(e,i,g),-  Aj-A, 

Where: 

A, 

Eq.  4.1-1 

Area  of  projected  surface  (cm^) 

Sra 

R^-  Ap  /cos(e)  -f^ 

Angular  area  of  sensor  aperture 

Ad 

(steradians)  equals  Ad/R^ 

Sensor  aperture  (cm^) 

Ap 

Pixel  Area  (cm^) 

f 

focal  length  of  detector  lens 

intensity.  A  gamma  correction  is  used  to  relate  the  pixel 
intensity  to  the  color  intensity  as  follows. 


Ir,g,b  ^  0 

>  Ip>. 

Ir,g,b  =  255-  [(Ip, 

Ip?^^Isat 
Ir,G,B  ^  I  sat 

Where: 


n)/(I 


p,sat 


)] 


Eq.  4.1-2 


IpX^Isat 


Ip, min  Minimum  detector  intensity( watts) 
Ip, sat  Detector  saturation  intensity(watts) 
y  Detector/monitor  response  (gamma) 


In  real  systems,  as  shown  in  Figure  6,  the  gamma 
correction  is  applied  at  least  twice.  The  first  time  it  is 
applied  when  the  measured  detector  response  unit 
(Voltage  level)  is  converted  into  an  intensity 
measurement  (watts).  Measurements  are  then  recorded  in 
watts  per  detector  element.  The  second  time  it  is  applied 
when  the  recorded  watts  are  reconverted  to  a  pixel 
response  (voltage  level)  which  we  call  Ir,g,b- 

In  an  ideal  scene  measurement  and  display  system,  the 
gamma  functions  cancel  exactly.  The  monitor,  or 
photograph,  could  be  taken  into  the  field  and  placed  in 
front  of  the  natural  scene  without  any  discemable 
difference.  Of  course  such  ideal  systems  are  not 
realizable  but  people  along  the  data  route  make  careful 
and  mutually  canceling  adjustments  in  order  to  maintain 
the  natural  look  of  the  scene  and  thus  the  overall  system 
gamma  value  of  unity  is  approximated.  If  the  monitor 
gamma  and  brightness  knob  adjustments  could  be 
included,  the  mathematics  in  this  section  would  be 
superfluous. 


Note  the  slant  range  R  cancels  and  the  area  A^  from 
which  radiation  is  emitted  gets  larger  by  l/cos(e)  as  e 
approaches  90  degrees.  We  can  also  see  one  of  the  major 
non-physical  aspects  of  the  OpenGL  formulation  in  eq. 
4.1-1  when  we  consider  what  happens  when  we 
physically  “zoom  in”  on  a  surface  element.  In  a  physical 
device  using  a  zoom  lens,  the  effective  focal  length  gets 
larger  and  thus  the  intensity  of  radiation  falling  on  a 
detector  gets  smaller.  In  a  simulator,  the  color  intensity 
stays  constant.  If  one  zooms  in  close  enough,  the  bright 
color  of  the  surface  element  simply  covers  the  whole 
screen.  In  the  physical  world,  one  runs  out  of  photons. 
The  dependency  of  intensity  on  zoom  is  not  physical  in 
the  OpenGL  formulation. 

In  practice,  the  pixel  intensity  is  neither  recorded  at  the 
detector  element  or  calculated  by  an  OpenGL  simulator. 
What  is  recorded  and  needs  to  be  calculated  is  the 
detector  response  as  a  voltage  level  of  an  apparent  color 


Also  shown  in  Figure  6  are  two  additional  alternative 
data  transfer  paths  from  the  remote  sensing  side  to  the 
simulation  side.  The  upper  path  represents  the  direct 
measurement  transfer  of  gray  shade  or  color  values.  This 
method  is  used  when  ortho-photographs  are  draped  over 
digital  elevation  models.  Draped  databases  can  generate 
realistic  three  dimensional  scenes  when  viewed  from 
high  altitude  positions. 

The  lower  path  represents  the  goal  of  our  project.  Here 
we  decode  surface  radiance  into  intrinsic  parameters 
describing  the  surface.  Maps  or  geographic  databases  of 
these  values  are  then  transferred  to  the  simulation 
community  that  can  use  an  encoder  module  to  reconstruct 
the  scene.  The  advantage  of  our  approach  is  that  ground 
objective  knowledge  is  preserved  and  scenes  are  no 
longer  dependent  on  the  measurement  sensor  view 
conditions. 


Figure  6:  Real  Sensor  Measurement  to  Simulator  System  Block  Diagram 


4.1.1  Linear  Approximation  to  OpenGL  Equation 

Both  OpenGL  and  the  Hapke-Shepard  physieally  based 
model  divide  the  surfaee  radiation  problem  into  diffuse, 
speeular,  emissive,  and  (in  OpenGL  only)  ambient  terms. 
The  non-linearity  of  the  gamma  transformations  makes 
the  term  by  term  summation  of  the  OpenGL  physieally 
ineorreet.  Color  levels  do  not  added  linearly. 


Nevertheless,  if  we  aceept  some  error,  it  ean  be  done  by 
linearizing  the  equation  4.1-2  as  follows.  We  now  ehose 
an  average  pixel  power  value  (Jp,av  )and  a  deviation  (5Jp  ), 
write  the  differenee  and  expand  around  the  average: 


(Ip-Im.„)  =  (Ip,av-Uin  +5Ip)  ^  ~  (Ip,av-Im.„  f  +  Y  Ip.av^'"'  6Ip. 


The  linearized  form  of  equation  4.1-2  is  then. 


1r,G,B  255'  (Ip^av“  Ip, min)  /(Ip, sat  Ip, min  ) 

+  255-(y  (Ip,av-  Ip, min)  5Ip)/(Ip,3at  -  Ip, min  Y  Cq.  4. 1 

-3 


The  first  term  is  the  expansion  point  color  offset  while  the 
second  term  is  linear  in  5Ip  If  this  second  term  is  written 
as  a  product  of  equal  power  of  gamma , 

255'Y  {  (Ip,av”  Ip,min) /(Ip,sat  ”  Ip,min  )  {^Ip/(Ip,sat  ”  Ip,min  )} 


we  can  substitute  the  surface  leaving  radiance  because  the 
Aj-Ap  /Y  term  from  equation  4.1-1  appears  in  both  the 
numerator  and  denominator  of  equal  powers. 

255-Y  {(U,av-Il,min)/(Il  ,sat  Ix.,min  )  }"■'  {5Ix/(I;,  ,sat  Ix.,min 

)} 

Here  we  use  A,  to  refer  to  the  I(e,i,g);^  of  the  Hapke- 
Shepard  equation.  Expanding  51;^  in  terms  of  the  ambient, 
diffuse,  and  specular  reflectivity  (pa,Pd,Ps),  the  input 
irradiance  values  (Ja  ,Jd,Js)  with  units  of  watts/cm^,  and 
the  emissive  radiance  gives, 

SI:t  =  Pa  5Ja+  Pd  5Jd+  Ps  5Js+  5Ie  cq.  4.1  -4 

If  we  substitute  this  radiance  difference  back  into  the 
equations  above  we  get  the  linearized  physical  equivalent 
OpenGL  equation. 

Ir,G,B  255*  {  (I>.,av”  Ix.,min) /(I>.,sat  “  Ix.,mm  )  } 

+  255-y  (I;,  ,av  Ix,,min) /(Ix,sat  Ix,,min  )  }^''{(Pa  5Ja+  Pd  SJd+ 
Ps  dig  )/(I>.,sat  ”  Ix,min  )} •  eq.  4.1  5 

The  5Ja  5Jd  5Js  dig  values  are  not  absolute  values,  but 
rather  are  the  difference  from  the  expansion  point.  These 
values  go  positive  and  negative.  We  would  like  to  get  a 
positive  value  only.  If  we  offset  the  linear  term  by 
defining  new  A  variables. 


dJa  AJa  (Ix,av  I>.,min)/  dyp 


6Jd  AJd  -  (Ix^av"  I>u,min)/  ^YPd 
6Js  AJs  “  (I>„,av“  I>u,min)/  ^YPs 

Sle  Ale  “  (I>u,av“  I>L,min)/  4y 

Then  when  AJa  =  AJj  =  AJ^  =  Ale  ^  0  the  Ir,g,b  of 
equation  4.1-5  becomes  zero.  Effectively  this  change  of 
variables  defines  the  zero  level  of  Ir,g,b  and  eliminates 
the  first  term  of  equation  4.1-5. 

1r,G,B  255'Y  {(Il,av“  I?^,min) /(Il.sat  “  )  }  {(Pa 

AJa“t“Pd  AJd  “t“  Ps  AJs-f-  Ale  )/(!>., sat  “  )}  •  Oq. 

4.1-6 


4.3  Specular  Reflection  Mapping 

We  now  consider  specular  reflection.  The  open  GL 
shininess  parameter  is  very  closely  related  to  the  Shepard 
smoothness  P(0)  =  exp[-s  tan(0)]  sr-1  (eq  16  ref  [4]). 
Numerical  calculation  shows  that  to  within  a  few  percent 
the  following  functions  are  equivalent. 

[max(cos(0),O)]^  =  P(0)  =  exp[-.i4(;  tan(0)] 
eq.  4.3-1 

Hence  we  have  a  mapping  between  the  Shepard  specular 
term  and  the  OpenGL  equation 


With  this  adjustments  we  can  now  formally  identify 
OpenGL  parameters  with  physical  parameters  as  follows, 

Pa  (f?.,av“  I>.,sat  “  I?., min)  }  Pa 

Ja  [(AJa)/(  I>.,sat  “  Ix.min)] 

Pd  max(l‘n,0)  255'Y  {  (Il,av“  I?.,min)/(  I?., sat  “  I>.,min)  } 

Pd 

Jd  [(AJd)/(  I?,, sat  “  I>.,min)] 


Ps  =  Ps  '[^^^(5'llt0)]  /[255'Y  {(  I>.,av“  l>.,min)/(  l>.,sat  “  l?.,min) 
]=  R  exp[-.54(;  tan(0)]  /  4p 
eq.  4.3-2 

Hence  the  OpenGL  parameter  for  a  specular  reflection 
coefficient,  be  given  by 

Pa  =  255-y{  (I;^,av-  Ix,min)/(  Ix.sat  '  lit, min)  (R  /  4p) 

eq.  4.3-3 


Ps  max(S'n,0)  255'Y  {  (I>.,av“  I>t,min)/(  lit.sat  “  I?t,min)  } 

Ps 

Js  ~  [(^Jd)/(  Ix.,sat  “ 

Ps  =  255-Y  (I;t,av-  lit, min) /(lit, sat  '  Iit,min  )}''"'  [(AIe)/(  Iit,sat  ' 

Ii.,min)] 

eq.  4.1  -7 

By  multiplying  the  left  side  terms  and  adding  to  get  the 
OpenGL  equation  on  the  right  we  get  eq.  4.1-6.  This  is  a 
linear  approximation  of  a  physically  correct  definition  of 
Ir,g,b  given  in  equation  4.1-2.  Note  in  each  case  the  p 
values  are  defined  as  the  physically  correct  reflectivity 
functions  connecting  input  irradiance  and  reflected 
radiance  in  the  ambient,  diffuse  and  specular  terms. 

Now  that  we  have  term  by  term  correspondence  between 
the  OpenGL  equation  in  physical  quantities  we  can 
proceed  with  the  rest  of  the  mapping  task. 


Note  when  gamma  equals  unity  this  is  merely  a  scale 
change  from  the  physical  range  0  to  1  to  the  color  range  0 
to  255.  The  appearance  of  the  cosine  of  the  view  zenith 
angle  (p)  in  the  denominator  is  surprising.  Such  a  term 
would  increase  the  reflectance  of  a  mirror  surface  when 
viewed  at  grazing  angles.  This  is  not  realistic.  We  are  also 
not  happy  that  macro  scale  features  are  not  included  to 
decrease  the  specular  term  due  to  self  shadowing  in  the 
Hapke-Shepard  formulation.  We  expect  an  improvement 
to  this  theory  will  be  forthcoming  but  such  an  extension  is 
beyond  the  scope  of  the  current  paper. 


4.4  Diffuse  Term  Mapping 

The  ambient  reflection  coefficients  of  OpenGL,  pa, 
should  be  given  by  the  second  term  in  eq.  4.1-3  where  pd 
is  identified  from  eq.  2  as. 


Pd  ^r{i,e,g)^ 


(o  Po 

ju^+ju 


{[l  +  B{g)\p{g)  +  H{ju^  )H{ju)  - 1} 


eq.  4.4-1 


4.2  Ambient  Term  Mapping 

There  is  no  direct  correspondence  between  the  ambient 
OpenGL  term  and  the  Hapke-Shepard  equation.  It  may  be 
proper  to  let  Pa  be  given  by  an  expression  describing  a 
hemispherical-directional  (hd)  reflectance  term  (e.g.,  eq. 
10.19  of  Hapke  [3]  for  rhd)-  This  is  because  an  object 
that  is  illuminated  by  sky-shine  is  hemispherically 
illuminated  (minus  the  spot  at  which  the  sun  is  situated) 
and  is  viewed  by  a  sensor  such  as  AVIRIS  or  HYDICE  in 
a  directional  fashion  (in  addition  to  the  usual  bidirectional 
viewing/illumination  scenario  of  remotely  sensed  data 
during  cloud-free  conditions). 


where  B(g)  is  a  term  describing  the  opposition  effect;  p(g) 
is  the  phase  function,  g  is  phase  angle,  ro  is  single¬ 
scattering  albedo,  p  and  po  are  the  cosines  of  the  viewing 
and  illumination  zenith  angles,  respectively,  and  H(x)  is 
the  H-function  of  Chandrasekar  [9]. 

Note  that  the  term  max(/-n,0)in  eq.  3  (second  term  of 
eq.  4.1-3)  does  not  appear  in  the  Hapke-Shepard 
formulation.  This  term  converts  the  incident  solar 
radiation  measured  in  watts/sqcm,  where  the  area  is 
defined  as  perpendicular  to  the  incoming  ray,  into  the 
incident  solar  irradiance,  where  the  area  is  measured  in 


terms  of  sqcm  of  illuminated  surfaee.  As  the  ineident 
angle  deereases,  the  power  density  deereases  by  the 
eosine  of  the  ineident  angle.  Given  this  definition,  the 
OpenGL  diffuse  term  models  a  Lambertian  surfaee.  Sueh 
a  surfaee  looks  like  it  has  the  same  eolor  and  intensity 
independent  of  the  view  angle.  Empirieally  this 
eorresponds  to  the  first  order  behavior  of  surfaees 
eneountered  in  mueh  of  human  experienee.  For  this 
reason  it  is  the  basis  of  the  graphies  modeling  eommunity 
rendering  approaeh. 

The  Flapke- Shepard  equations  do  not  reduee  to  a 
Lambertian  surfaee  under  any  assumption  of  isotropy. 
This  gives  eause  for  eoneem.  The  history  and  derivation 
of  this  term  [11]  indieates  assumptions  regarding  the 
partiele  spaeing  makes  this  theory  more  applieable  for 
planetary  regolith  surfaee  modeling  than  for  1  meter  earth 
surfaee  applieations.  As  with  the  speeular  term,  we  expeet 
an  improvement  to  this  theory  will  be  fortheoming  but 
sueh  an  extension  is  beyond  the  seope  of  the  eurrent 
paper. 

On  the  other  hand  the  Flapke  diffuse  term  addressed 
important  eharaeteristies  of  natural  surfaees  not  found  in 
the  OpenGL  model.  The  opposition  effeet  is  eouehed  in 
terms  of  the  definitions  of  pd  (i.e.,  r(i,e,g))  presented  as 
the  funetion  B(g)  in  eq.  4.1-1.  The  baekseatter  or  "hot 
spot"  deseribed  by  the  opposition  effeet  is  not  eurrently 
aeeounted  for  in  OpenGL;  the  addition  of  this  parameter 
will  allow  users  to  better  model  vegetation  and  other 
partieulate  surfaees. 

OpenGL  also  requires  definition  of  the  illumination  (or 
lighting)  terms,  Ja,  Js,  and  Ja:  irradianee  ineident  on  seene 
objeets  due  to  ambient  lighting,  light  that  will  be 
speeularly  refleeted,  and  diffuse  or  skyshine  irradianee, 
respeetively.  These  terms  should  be  defined  as  follows: 
Js  and  Jd  are  synonymous  terms  and  are  to  be  provided  by 
standard  bottom  of  atmosphere  radianee  values  produeed 
by  a  radiative  transfer  eode  sueh  as  MODTRAN.  Ja  is 
also  to  be  provided  by  MODTRAN  and  ealeulated  as 
deseribed  by  Sehott  [10]. 

4.4  Infra  Red  Mapping 

For  VNIR/SWIR  seene  simulation  using  the  Hapke- 
Shepard  theory,  we  first  assume  that  the  self-emission  of 
radianee  equates  to  the  OpenGL  parameter  /Ug  .  This 
parameter  is  direetly  related  to  the  thermal  emission 
radianee  by  a  level  eonversion  faetor  of  255  as  defined  in 
equation  4.1-3.  Thus  there  is  essentially  no  model  in 
OpenGL  for  thermal  emission.  It  simply  provides  a  plaee 
to  write  the  answer.  The  Hapke  theory  is  not  well  known 
among  IR  workers.  Surfaee  temperature  does  eome  in 
through  Planek  emission  funetion  .  Emission  modeling  in 
terms  of  temperature,  eonduetivity,  and  heat  absorption 
would  be  more  useful. 


Again  we  feel  the  Hapke  theory  requires  improvement  or 
adaptation  to  more  useful  and  familiar  forms. 


5,  Standard  Surface  Rendering  Equation 
Summary 

Though  the  Hapke-Shepard  model  elaims  to  provide  a 
rigorous  physieally  based  approaeh  we  have  found 
defieieneies  whieh  limit  its  applieability  to  1  meter  seale 
earth  surfaee  modeling.  Furthermore,  it  laeks  the 
simplieity  and  intuitive  appeal  of  the  artistieally  based 
OpenGL  model.  Table  1  shows  a  direet  eomparison 
between  the  two  models. 

Hapke-Shepard  eontains  one  illumination  souree  that 
matehes  our  applieation.  There  is  one  illumination  souree, 
the  sun,  generating  both  speeular  and  diffuse  light. 

The  ambient  term  from  the  OpenGL  model  does  not 
appear  in  Hapke-Shepard.  A  more  rigorous  treatment 
would  suggest  this  term  should  be  modeled  by  a  full 
r(i,e,g)  term  integrated  over  all  direetions,  however  the 
simple  OpenGL  approximation  should  be  adequate. 

The  diffuse  term  differs  markedly  between  the  OpenGL 
and  Hapke-Shepard  treatment.  The  differenee  eomes 
about  from  the  way  in  whieh  these  equations  are  used.  In 
eomputer  graphies,  round  surfaees  are  approximated  by  a 
series  of  smaller  triangles.  Eaeh  triangle  is  given  its  own 
surfaee  normal  and  is  assumed  to  be  maeroseopieally  flat. 
If  it  is  not  flat  enough,  more  triangles  are  added.  The 
shininess  parameter  then  defines  the  finish  of  the  flat 
surfaee  (mat,  glossy,  semigloss,  ete)  and  deseribes  its 
miero-detail.  The  highlight  intensity  of  eaeh  of  these 
triangles  is  well  represented  by  the  power  of  the  angle 
between  the  primary  refleeted  direetion  and  the  view 
angle.  This  effeet  is  aetually  represented  in  the  veetor 
form  is  the  OpenGL  speeular  term. 

In  the  remote  sensing  eommunity,  surfaee  divisions  are 
seldom  based  on  loeal  geometry.  One  divides  the  earth 
surfaee  into  eonvenient  resolution  eells  (Im^  in  our  ease) 
within  whieh  many  faeet  orientations  are  assumed  to 
oeeur.  One  does  not  make  the  resolution  eells  smaller  to 
aeeommodate  maeroseopie  roughness,  as  in  eomputer 
graphies,  but  rather  defines  a  probability  funetion  P(0) 
that  a  faeet  is  oriented  in  sueh  a  way  as  to  refleet  into  the 
sensor.  The  assumption  behind  the  Shepard  speeular  term 
in  eq.  2  is: 

1)  that  the  faeet  is  a  perfeet  refleetor  and 

2)  the  seattering  angle  0  is  the  appropriate  measure  to 
parameterize  the  probability  funetion. 


painted  surfaces,  oily  roads)  are  not  accurately 
Neither  of  these  assumptions  are  true  in  general.  represented. 

Consequently,  mirror  like  objects  (glass,  still  water. 


Table  5-1:  Summary  of  Rendering  Models 


TERM 

EFFECT 

OpenGl 

Hapke-Shepard 

Ambient 

Color  of 

Shadowed 

Surface 

!^a  J  a 

NA 

Diffuse 

Color  of 

Illuminated 

Surface 

Hd^d  max(l»n,0) 

r(i,e,g)-  id 
eq.  12 

(l-B(g)  )=>1 

Opposition 
Effect  or 
Shadow 

Hiding 

NA 

r(i,e,g)-  id 
eq.  12 

(l-B(g))  =>B(g) 

Specular 

Highlight 

Glint 

jUs  iJmax(s»-n.01‘" 

id  RP(e)/4p 

Emissive 

Eights  or 
Thermal 
emission 

Me 

Eq  2  third  term 

OpenGL  represents  the  specular  behavior  of  surface 
finishes  well  but  badly  approximates  macro  roughness 
with  a  texture.  Hapke-Shepard  describes  macro 
roughness  well  but  fails  to  consider  the  finish  of  most 
man-made  and  some  natural  surfaces.  What  is  needed  is  a 
specular  term  that  accommodates  both  effects. 


6,  Conclusion 

Standardization  of  a  surface  rendering  equation  is  one  of 
several  necessary  steps  required  to  provide  a  mechanism 
whereby  sensor  measurements  of  earth  surface  patches 
can  be  processed  into  a  standard  objective  earth  surface 
database.  By  knowing  the  equation  standards,  simulation 


developers  can  regenerate  sensor  signatures  used  to 
initially  build  the  world  map  and,  perhaps  more  critical, 
can  consistently  calculate  such  signatures  for  other 
viewing  times  and  conditions. 

We  have  presented  what  we  believe  to  be  the  best  and 
most  accurate  surface  modeling  theory  available  from  the 
remote  sensing  community.  By  comparing  this  theory 
with  its  counterpart  in  the  computer  simulation 
community,  we  had  hoped  to  build  a  mapping  of  terms 
and  parameters.  Such  a  mapping  would  then  form  the 
basis  of  data  transfer  from  remote  sensing  to  the  computer 
simulation  community.  Instead,  the  examination  of  both 
approaches  shows  severe  differences  and  limitations  in 


ambient,  diffuse,  specular,  and  emissive  terms.  More 
work  is  therefore  required  to  integrate  these  two  bodies  of 
work. 

This  paper  is  part  of  a  series  of  SISO  workshop 
submissions  designed  to  build  the  infrastructure  for  an 
earth  surface  material  database  at  1  meter  resolution.  We 
recognize  the  technical  compromise  inherent  in  all  such 
efforts  and  encourage  you  to  submit  comments, 
contributions,  and  suggestions  to  any  one  of  the  authors. 
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